Web Survey Bibliography
It is common survey practice to convert a series of yes/no (forced-choice) items in telephone surveys to check-all-that-apply items in web and mail surveys. However, relatively little is known about how these different question formats may influence answers. This paper reports results from two web experiments and a comparison paper experiment in which nine different questions, varying in substantive topic and type (opinion-based and fact/behavior-based) were asked in 16 experimental comparisons of the check-all and forced-choice formats. Our purpose was to determine whether this change in question format influenced the number of response options marked affirmatively within each question and why any differences might occur. Results revealed that in every instance respondents marked significantly more items in the forced-choice format than in the check-all format. Given these results, detailed analyses of response patterns within questions, answering time, and alternative wording structures of questions were undertaken to examine which of three theories (satisficing, depth of processing, and acquiescence) best accounted for the response differences across question formats. These analyses indicated that the forced-choice format appears to invoke deeper processing and to eliminate satisficing behavior that occurs among some respondents to the check-all format, but that acquiescence does not seem to be an issue in the forcedchoice format. Thus, it appears that the use of the forced-choice question format is a desirable alternative to the use of the check-all question format for multiple answer questions. In addition, the findings reported here give ample reason to be concerned about the current practice of automatically converting items from the forced-choice format to the check-all format or vise versa when switching between telephone and paper or web surveys.
Conference program
Web survey bibliography (4086)
- Adding Value to Data Through Improved Access. The Case for Web Portals; 2005; Baker, R. P.
- Multi-Mode Research and Data Linkage. Theoretical and Practical Advice; 2005; Terhanian, G.
- Architectural Design of a Survey Questionnaire and Respondent Data Repository. Practical Considerations...; 2005; Cookson, P., Sobell, J.
- Developing and validating a nursing website evaluation questionnaire; 2005; Tsai, S. - L., Chai, S.-K.
- Workaround: Site’s surveys beat pop-up blockers, yield responses; 2005; Arnold, C.
- The Story of Subject Naught: A Cautionary but Optimistic Tale of Internet Survey Research; 2005; Konstan, J. A., Ross, M. W., Rosser, B. R. S., Stanton, J. M., Edwards, W. M.
- Standards in Online Surveys. Sources for Professional Codes of Conduct, Ethical Guidelines and Quality...; 2005; Kaczmirek, L., Schulze, N.
- Computer adaptive testing; 2005; Gershon, R. C.
- Ego control and ego-resiliency: Generalization of self-report scales based on personality descriptions...; 2005; Block, J., Funder, D. C., Letzring, T. D.
- The Web experiment list: A Web service for the recruitment of participants and archiving of Internet...; 2005; Reips, U. -D., Lengler, R.
- Survey of substance use among high school students in Taipei: Web-based questionnaire versus paper-and...; 2005; Wang, Y. C., Lee, C. M., Lew-Ting, C. Y., Hsiao, C. K., Chen, W. J.
- Web Surveys. A Brief Guide on Usability and Implementation Issues; 2005; Kaczmirek, L.
- An assessment of measurement invariance between online and mail surveys ; 2005; Deutskens, E., de Ruyter, K., Wetzels, M.
- E-mail versus Web survey response rates among health education professionals; 2005; Kittleson, M. J., Brown, S. L.
- Toward An Open-Source Methodology: What We Can Learn From The Blogosphere; 2005; M.
- Aux Abonnes Absents: Liste Rouge Et Telephone Portable Dans Les Enquetes En Population Generale Sur...; 2005; Beck, F., ., Peretti-Watel, P.
- Web Versus Paper Questionnares: A Design and Functionality - Comparison; 2005; Jones, Ja., Fraser, C., Dowling, Z.
- Web Surveys and the new Disability Discrimination Act; 2005; Macer, T.
- Mixed-mode Surveys Using Mail and Web Questionnaires; 2005; Meckel, M., Baugh, P., Walters, D.
- Sampling procedure, questionnaire design, online implementation; 2005; Jackob, N., Arens, J., Zerback, T., Jowell, R., de Rouvray, C.
- Simple Approaches to Estimating the Variance of the Propensity Score Weighted Estimator Applied on Volunteer...; 2005; Isaksson, A., Lee, S., de Rouvray, C.
- Simple Approaches to Estimating the Variance of the Propensity Score Weighted Estimator Applied on Volunteer...; 2005; Isaksson, A., Lee, S.
- Alternative Modes for Health Surveillance Surveys: An Experiment with Web, Mail, and Telephone; 2005; Link, M. W., Mokdad, A.
- An Experimental Comparison Of Web And Telephone Surveys; 2005; Fricker, S., Galesic, M., Tourangeau, R., Yan, T.
- Organizational Virtual Communities: Exploring Motivations Behind Online Panel Participation; 2005; Daugherty, T., Lee, W.-N., Gangadharbatla, H., Kim, K., Outhavong, S.
- Promoting Uniform Question Understanding in Today's and Tomorrow's Surveys; 2005; Conrad, F. G., Schober, M. F.
- Is a Web survey as effective as a mail survey? A field experiment among computer users; 2005; Kiernan, N. E., Kiernan, M., Oyler, M. A., Gilles, C.
- The effect of personalization on response rates and data quality in web surveys; 2005; Heerwegh, D., Vanhove, T., Matthijs, K., Loosveldt, G.
- When Methodology Interferes With Substance; 2005; Schoen, H., Faas, T.
- Web-based and Mailed Questionnaires: A Comparison of Response Rates and Compliance; 2005; Baelter, K., Balter, O., Fondell, E., Trolle-Lagerros, Y.
- Bleeding Edge or Proven Technology? The Fact and the Fiction of Mobile Survey Computing; 2005; Cameron, M. R.
- Compilation of Composite Satisfaction Index in User Satisfaction Survey; 2005; Sam Min, K., Park, Ju.
- Unintended Consequences of Incentive Induced Response Rate Differences; 2005; Pope, D., Crawford, S. D., Johnson, E. O., McCabe, S. E.
- Mode Effects in Customer Satisfaction Measurement; 2005; Steiger, D. M., Keil, L., Gaertner, G.
- From Crayons to Computers: The Evolution of Computer use in Redistricting; 2005; Altman, M., MacDonald, K., McDonald, M.
- Survey Measures of Web-Oriented Digital Literacy; 2005; Hargittai, E.
- Vote Over-Reporting: Testing the Social Desirability Hypothesis in Telephone and Internet Surveys; 2005; Holbrook, A. L., Krosnick, J. A.
- Using the Web to Survey College Students: Institutional Characteristics That Influence Survey Quality...; 2005; Crawford, S. D., McCabe, S. E., Inkelas, K. K.
- Visual Context Effects in Web Surveys; 2005; Couper, M. P., Conrad, F. G., Tourangeau, R.
- The Labelling Game: A Conceptual Exploration of Deviance on the Internet; 2005; Denegri-Knott, J., Taylor, J.
- Comparing Check-All and Forced-Choice Question Formats in Web Surveys: The Role of Satisficing, Depth...; 2005; Smyth, J. D., Dillman, D. A., Christian, L. M., Stern, M. J.
- Data Collection Mode Effects Controlling for Sample Origins in a Panel Study: Telephone versus Internet...; 2005; Dennis, J. M., Chatt, C., de Rouvray, C., Pulliam, P.
- An Empirical Evaluation of Three Web Survey Design Principles; 2005; Healey, B., Macpherson, T., Kuijten, B.
- In my opinion; 2005; Haley, F.
- Eight tips offer best practices for online MR; 2005; Kottler, R. E.
- Get the most from Net-based panel research; 2005; Philpott, G.
- Evaluation of Noise-Induced Hearing Loss in Young People Using a Web-Based Survey Technique.; 2005; Chung, J. H., des Roches, C. M., Meunier, J., Eavey, R. D.
- Demands on web survey tools for epidemiological research; 2005; Baelter, O., Baelter, K.
- The Quality of Ego-Centered Network Data: A comparison of online versus offline data collection; 2005; Snijders, C., Matzat, U.
- Meta-Analyses on Contingent versus Unconditional Incentives; 2005; Goeritz, A.